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(54) Data compression 

(57) Data compression apparatus in which input da- 
ta is compressed according to a target output data quan- 
tity using a stage of data quantisation, the apparatus 
comprises: one or more trial quantisers for selecting a 
degree of quantisation so that the target output data 
quantity is not exceeded; a data selector for selecting a 
subset of the current data to be quantised; a data store 
for storing the subset of data; a backsearch quantiser 
and dequanliser for sequentially quantising and de- 
quantising the subset of data at a plurality of degrees of 
quantisation including the degree of quantisation select- 



ed by the trial quantiser(s) and one or more harsher de- 
grees of quantisation; a comparator tor comparing data 
quantised and dequantised by the backsearch quantiser 
with the stored subset of data, to detect errors intro- 
duced by the quantisation and dequantisation by the 
backsearch quantiser; and a quantisation selector for 
selecting a final degree of quantisation for use in com- 
pression of the current data, the final degree of quanti- 
sation being that degree detected by the comparator to 
introduce the fewest errors during quantisation and de- 
quantisation of the subset of data by the backsearch 
quantiser. 
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Description 

[0001] This invention relates to data compression. 
[0002] Some data compression systems, such as im- 
age data compression systems, use trial compressions s 
totry toarrive at the most appropriate quantisation tactor 
to achieve a desired output bit rate. 
[0003] In one previously proposed system, trial quan- 
tisations are carried out at, say, ten possible quantisa- 
tion values spread across the available range of quan- 
tisation values. The two trial quantisation values which 
provide an output bit rate falling either side of the desired 
value are identified, and a more detailed trial carried out 
in the reduced range between those two values. This 
can identify the quantisation value corresponding to the 
least harsh quantisation of the data which still complies 
with the target bit rate of the system. 
[0004] However, it has been established that for some 
classes of data - for example, image data and/or data 
which has previously been compressed and decom- 
pressed -this arrangement does not necessarily provide 
the best quantisation value. A process sometimes re- 
ferred to as "backsearch* has been devised to alleviate 
this problem. 

[0005] The backsearch process starts with the quan- 
tisation value identified by the trial quantisations re- 
ferred to above, and then tests that value and a number 
of adjacent values providing successively harsher de- 
grees of quantisation. The test used is to apply quanti- 
sation followed immediately by dequantisation to the in- 
put data using each of the values under test and, in each 
case, to compare the resultant data with a delayed (i.e. 
not quantised) version of the input data. The quantisa- 
tion value (of those tested) giving the fewest errors is 
then selected for the final, output stage of quantisation. 
[0006] However, like many aspects of data compres- 
sion, this additional test requires a large amount of fast 
processing circuitry in order to apply test quantisations 
and dequantisations to the input data at several quanti- 
sation values in parallel. This is a particular problem 
when the compression circuitry is to be implemented as 
an integrated circuit such as an ASIC (application spe- 
cific integrated circuit). 

[0007] This invention provides data compression ap- 
paratus in which input data is compressed according to 
a target output data quantity using a stage of data quan- 
tisation, the apparatus comprising: 

one or more trial quantisers for selecting a degree 
of quantisation so that the target output data quan- 
tity is not exceeded; 

a data selector for selecting a subset of the current 
data to be quantised; 
a data store for storing the subset of data; 
a backsearch quantiser and dequantiser for se- ss 
quentialiy quantising and dequantising the subset 
of data at a plurality of degrees of quantisation in- 
cluding the degree of quantisation selected by the 



trial quantiser(s) and one or more harsher degrees 
of quantisation; 

a comparator for comparing data quantised and de- 
quantised by the backsearch quantiser with the 
stored subset of data, to detect errors introduced by 
the quantisation and dequantisation by the back- 
search quantiser and 

a quantisation selector for selecting a final degree 
of quantisation for use in compression of the current 
data, the final degree of quantisation being that de- 
gree detected by the comparator to introduce the 
fewest errors during quantisation and dequantisa- 
tion of the subset of data by the backsearch quan- 
tiser. 

[0008] The invention recognises that the backsearch 
process can be performed and a useful result achieved 
using only a subset of the data to be quantised. This can 
dramatically reduce the amount of hardware needed to 
implement this function. 

[0009] In a preferred embodiment, instead of being 
performed in parallel, the backsearch process can be 
performed in a time-division-multiplexed fashion using 
just a single set of quantiser and dequantiser. 
[0010] Embodiments of the invention will now be de- 
scribed, by way of example only, with reference to the 
accompanying drawings, throughout which like refer- 
ences refer to like parts, and in which: 

Figure 1 is a schematic diagram of a bit-rate reduc- 
ing encoder and a corresponding decoder for use 
with a magnetic tape channel; 
Figures 2 to 4 schematically illustrate the bit-rate re- 
ducing encoder of Figure 1 ; 

Figure 5 schematically illustrates an element of a 
previously proposed backsearch unit; 
Figure 6 is a schematic diagram of a previously pro- 
posed backsearch unit; 

Figure 7 is a schematic diagram of a backsearch 
unit according to an embodiment of the invention; 
and 

Figure 8 is a schematic diagram ol a data stream 
generated by the data pre-processor. 

[0011] Figure 1 is a schematic diagram of a tape re- 
cording and reproducing system comprising a bit-rate 
reducing encoder 1 0, a tape channel 20, tape recording 
and reproducing apparatus 30 and a corresponding da- 
ta decoder 40. 

[0012] The encoder 10 receives an input high defini- 
tion video signal and encodes it to form a bit-rate re- 
duced (BRR) signal for recording on the tape medium. 
Similarly, the decoder 40 receives a BRR signal repro- 
duced from the tape medium and decodes it to form an 
output high definition video signal. 
[001 3] A stage of error correction coding for record- 
ing, and corresponding decoding for replay (not shown) 
may be employed. 
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[0014] Referring now to Figure 2, the input video sig- 
nal and a video clock are supplied to a field/frame adap- 
tion circuit 100, a phase lock loop 110, a video shuffler 
120 and a system controller 1 30. 
[0015] The field/frame adaption circuit 1 00 is used to 
control switching of the encoder between a frame-based 
mode of operation and a field-based mode of operation. 
This switching occurs at a scene change, so that a field- 
based mode of operation is used for the frame of a scene 
change. 

[0016] In order to detect a scene change in the input 
video signal, the field/frame adaption circuit 1 00 divides 
each input field into 16 blocks, each being 300 pixels by 
135 lines. The dc level and variance of each block for 
each field are then calculated as follows: 

dc = X (pixel value) 

variance = X (pixel value) 2 
[0017] The variance of the blocks is then normalised 
as follows: 

normalised variance = X (pixel value) 2 / X (pixel value) 

[001 8] The dc level and variance for each block of the 
two fields comprising a single frame are then compared 
(on a block-by-corresponding-block basis) to detect 
whether the two fields are considered to be similar. The 
following relationships are used to make this detection: 

(a) ifdc fld1 x dc lowerthreshokJ > dc fld0 
anddc fld1 x dc upper threshold < dc fld0 

then dc fld1 is considered to be similar to dc fld0 

(b) ifvar fld1 x var lower threshold > var fld0 
andvar fld1 x var upper threshold < var fld0 

then var fld1 is considered to be similar to var fld0 

[0019] The number of dc and variance blocks that are 
similar between the two fields are then compared to sep- 
arate thresholds: 

if number_similar dcblocks > dc block threshold 
and number_similar varbk>cks > var block threshold 
then the two fields are considered to be part of the same 
video scene. 

[0020] The result of this detection is supplied on a 
control output 102 from the field/frame adaption circuit 
100. 

[0021] The PLL 110 receives the 46.4 MHz clock sup- 
plied to the encoder and derives other clock signals re- 
quired by the encoder apparatus from that clock signal. 
[0022] The system controller 1 30 controls the appa- 
ratus to operate in the manner described. 
[0023] The video shuffler 120 receives pixels of the 
input video signal and stores them temporarily in an ex- 
ternal shuffle RAM 140. It then reads blocks of pixels 
from the external shuffle RAM according to a predeter- 
mined shuffle pattern so that blocks of pixels which are 
adjacent in the image are not read out at adjacent posi- 



tions in the shuffle pattern. 

[0024] The reason for this measure is to try to alleviate 
the effect of data losses (e.g. due to a tape drop-out or 
similar) on the picture reconstructed by the decoder ap- 
5 paratus. Because pixel blocks which are adjacent in the 
image are separated from one another in the resulting 
bit stream (because they are shuffled by the video shuf- 
fler 120), a short duration data loss might affect a 
number of pixel blocks but not their immediate neigh- 
bours in the image. This allows data concealment to be 
used to reconstruct the missing blocks. 
[0025] The current frame is written to the external 
RAM while the previous frame is read, in a shuffled man- 
ner, from the external RAM. 

[0026] The shuffled data from the video shuffler 120 
is supplied to a discrete cosine transform (DCT unit 
150), an activity calculator 160 and (referring to Figure 
3) a bit allocator 170. 

[0027] The DCT unit 150 transform each pixel block 
supplied from the video shuffler 120 into a correspond- 
ing block of DCT coefficients using known techniques. 
These coefficients are supplied to the bit allocator 170. 
[0028] The activity calculator 1 60 generates so-called 
"activity codes" and corresponding offsets to be applied 
to the quantisation index for each block of data. These 
codes specify the so-called activity of each block, as- 
sessed according to the following principles: 

(i) a block containing more detail (measured for ex- 
ample by the variance of the pixel values within the 
block) has a higher activity than a block having less 
detail; 

(ii) a block predominantly containing colours asso- 
ciated with skin tones is quantised less harshly (i.e. 
given a lower notional activity) than a block predom- 
inantly not containing such colours; 

(iii) a block having a very low or a very high average 
luminance level is quantised more harshly (i.e. giv- 
en a higher notional activity) than a block having a 
mid-range average luminance level (Weber's law). 
For example, if a block's average luminance level 
is above 224 or below 32 (in an eight bit system) 
then a constant value is added to the calculation of 
the block's activity. If the block's average luminance 
level is between 32 and 224 then the activity calcu- 
lation is unaltered. 

[0029] In general, the activity codes are used to con- 
trol the later operation of the encoder, so that pixel 
blocks having a higher activity are subjected to harsher 
compression, since it is less likely that the viewer would 
spot compression artifacts in that block when the block 
is subsequently decompressed. Blocks having a low ac- 
tivity, e.g. relatively "smooth" surfaces, relatively dark 
areas or areas having colours corresponding to skin 
tones, are compressed less harshly, since the user is 
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more likely to spot compression artifacts in those areas. 
[0030] The quantisation index offsets are embedded 
in the bitstream, whereas the activity codes (which are 
needed to specify the quantisation offsets to be used on 
decoding) are supplied separately for possible "optimi- 
sation* - see below. 

[0031] The bit allocator 170 receives DCT data from 
the DCT encoder 150 and activity data from the activity 
calculator 160. The bit allocator 170 performs a trial 
quantization of the DCT data, followed by a trial part of 
an entropy encoding process. 

[0032] Using these techniques, the bit allocator cal- 
culates the number of bits which would be required to 
encode each DCT block at one of ten quantization 
-base" values: 7, 13, 19, 25, 31, 37, 43, 49, 55 and 61, 
subject to each block's quantisation index offset calcu- 
lated by the activity calculator. Ultimately, the quantiza- 
tion level for each block is selected to a resolution of 1 
(using the scale given above), but for the purposes of 
the bit allocator 170, the quantization base value is as- 
sessed to the nearest 6 on that scale. 
[0033] At the output of the bit allocator, therefore, a 
figure derived from the nearest appropriate quantization 
base level from the selection given above is passed, to- 
gether with a delayed version of the video data, to a fur- 
ther DCT unit 1 80, a binary search unit 1 90 and a back- 
search unit 200. This process will be described further 
below, but in brief, a value 2 greater than the quantisa- 
tion value giving just over the required bit rate is passed 
by the bit allocator. 

[0034] The further DCT unit 180 again calculates DCT 
coefficients, this time based on the delayed version of 
the video data. 

[0035] The binary search unit 190 carries out trial 
quantizations at quantization levels just above or just 
below the base quantization level, again modified by the 
quantisation index offsets associated with each block, 
to select one value within a range of -3 to +4 with respect 
to the base quantization level from the bit allocator. 
[0036] A further trial quantization is carried out by the 
backsearch unit which tests the quantization level se- 
lected by the binary search unit 190, and assesses 
whether a higher quantization level could be used whilst 
still obtaining the same or fewer quantisation errors. 
[0037] Finally, the selected quantization level, and the 
DCT blocks from the further DCT encoder 1 80, are sup- 
plied to a quantizer 210 where they are quantized ac- 
cording to the selected quantization level. The quan- 
tized data are passed to an entropy encoder 220 which 
generates variable length output data according to the 
standard principles of entropy encoding, so that more 
commonly occurring data patterns in the quantized data 
are encoded using shorter code words. 
[0038] The data generated by the entropy encoder is 
then packed into "code blocks" for recording on tape by 
a data packer 230. The code blocks include header da- 
ta, entropy-encoded data from a number of DCT blocks, 
activity codes associated with those blocks and an indi- 



cation of the quantisation level used in forming the 
blocks. Error correcting codes are then applied to pro- 
vide error correction when the code blocks are replayed 
from the tape. A code block comprises five "sync 
5 blocks", where a sync block is the smallest separately 
recoverable data item recorded on the tape in this sys- 
tem. 

[0039] Figure 5 schematically illustrates an element 
of a previously proposed backsearch unit. Backsearch 

io is a process for testing the quantization index value cho- 
sen by the binary search. As described above, binary 
search generates the lowest quantization index which 
produces fewer bits than the bit rate target. Backsearch 
then tests the six adjacent higher quantization indices 

15 to detect which is the best value to be used from those 
six choices. 

[0040] In Figure 5, an element of the backsearch unit 
comprises a test quantizer 600, an inverse quantizer 
610 using the same quantization index as the quantizer 

20 600, a subtracter 620 and a delay element 630. So, the 
DCT data is subjected to a quantization and comple- 
mentary inverse quantization process, then to be sub- 
tracted from a delayed version of the original DCT data. 
Carried out on the whole data stream, this comparison 

25 produces an error signal at the output of the subtracter 
620. 

[0041] Referring to Figure 6, a full backsearch unit 
comprises six elements 640 of the type shown in Figure 
5. Each of these elements 640 operates with a different 
30 quantization index, namely: 

Ql(out) 

QI(out) + 1 

QI(out) + 5. 

35 [0042] The error signals produced by each of the el- 
ements 640, representing the differences between the 
quantized and inverse-quantized DCT data and the orig- 
inal DCT data, are summed over a sync block and com- 
pared by a sum and compare unit 650. The sum and 

40 compare unit 650 selects that one of the possible quan- 
tization indices tested by the six elements 640 to be 
used in the final quantization stage for encoding the 
DCT data: Ql (final) - the quantisation index giving the 
lowest error rate summed over the sync block. 

45 [0043] Figure 7 is a schematic diagram of a back- 
search unit according to an embodiment of the inven- 
tion. 

[0044] The backsearch unit of Figure 7 comprises a 
data pre-processor700, followed by a quantiser 710, in- 

so verse quantiser 720, subtractor 730 and delay 740 sim- 
ilar to those shown in Figure 6. The output of the sub- 
tractor 730 is connected to a sum and compare unit 750. 
[0045] In contrast to the previously proposed back- 
search unit described earlier, Figure 7 illustrates the 

55 whole of the backsearch unit, that is, the parts 710, 720, 
730 and 740 are not repeated six times as in Figure 6. 
The way in which this repetition of parts is avoided stems 
from the use and operation of the data pre-processor 
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700, and will be described below. 
[0046] The data pre-processor 700 selects and stores 
a subset of the data stream supplied to the backsearch 
unit. It then supplies the subset ot the data stream re- 
peatedly to the quantiser 710 in a time-division-multi- s 
plexed manner. At each repetition, the quantiser 710 
quantises the subset with a different quantisation factor, 
cycling through the range Ql(out) ... Ql(out) + 5. 
[0047] So, as a first data subset is processed, e.g. at 
a quantisation factor QI(out) : the resulting error amount io 
from the subtractor 730 is stored by the sum and com- 
pare unit 750. As the next subset is processed, at a 
quantisation factor QI(out)+1 , the resulting error amount 
is also stored. This process repeats, so that the sum and 
compare unit 750 builds up six cumulative stored error 15 
values over the course of processing a sync block, one 
value for each of the six possible quantisation factors Ql 
(out)... Ql (out) +5. At the end of processing a sync block, 
the quantisation factor of the six possible values which 
gives the lowest cumulative error value is selected for 20 
the eventual quantisation of that sync block. 
[0048] Figure 8 is a schematic diagram of a data 
stream generated by the data pre-processor. 
[0049] Each sync block is formed of a number of suc- 
cessive 64 byte DCT blocks 800, with one byte of control 25 
information 810. The data pre-processor 700 selects 
and stores a 1 0 byte subset 820 of the DCT block 800, 
and outputs that subset six times. By arranging that the 
subset 820 is no more than one sixth of the length of the 
original DCT block, the six repetitions of the subset 820 30 
can be made in the time normally allocated to transmis- 
sion of the original DCT block 800. So, the six trial quan- 
tisations and dequantisations required for the back- 
search process can be performed successively, rather 
than in parallel, by using a single set of apparatus 710, 3$ 
720, 730, 740 rather than six such sets in parallel. 
[0050] As shown in the lower part of Figure 8, five 
bytes of padding data are added after the six repetitions 
of the subset 810, to make up the same quantity of data 
as the original DCT block 800. 40 
[0051] The subset B1 0 selected by the data pre-proc- 
essor can be, for example, 1 0 DCT coefficients selected 
from predetermined positions within the data stream (e. 
g. the first 10 coefficients), 10 non-zero coefficients (e. 
g. the first 1 0 non-zero coefficients or the 1 0 largest co- 45 
efficients), or another predetermined or pseudorandom- 
ly selected pattern. 



Claims so 

1. Data compression apparatus in which input data is 
compressed according to a target output data quan- 
tity using a stage of data quantisation, the appara- 
tus comprising: ss 

one or more trial quantisers for selecting a de- 
gree of quantisation so that the target output 



data quantity is not exceeded; 
a data selector for selecting a subset of the cur- 
rent data to be quantised; 
a data store for storing the subset of data; 
a backsearch quantiser and dequantiser for se- 
quentially quantising and dequantising the sub- 
set of data at a plurality of degrees of quantisa- 
tion including the degree of quantisation select- 
ed by the trial quantiser(s) and one or more 
harsher degrees ol quantisation; 
a comparator for comparing data quantised and 
dequantised by the backsearch quantiser with 
the stored subset of data, to detect errors intro- 
duced by the quantisation and dequantisation 
by the backsearch quantiser; and 
a quantisation selector for selecting a final de- 
gree of quantisation for use in compression of 
the current data, the final degree of quantisa- 
tion being that degree detected by the compa- 
rator to introduce the fewest errors during quan- 
tisation and dequantisation of the subset of da- 
ta by the backsearch quantiser. 

2. Apparatus according to claim 1 , in which: 

data to be quantised is received sequentially by 
the data selector in data blocks; 
the data selector is operable to select a subset 
of each block of data; 

the data selector and/or data store is operable 
to supply the subset to the backsearch quan- 
tiser and dequantiser repeatedly, with one rep- 
etition for each of the plurality of degrees of 
quantisation. 

3. Apparatus according to claim 2, in wh ich the subset 
is less than or equal to the block size divided by 
number of repetitions. 

4. Apparatus according to any one of the preceding 
claims, in which the data to be quantised are data 
representing one or more images. 

5. Apparatus according to any one of the preceding 
claims, in which the data to be quantised are fre- 
quency separated data. 

6. Apparatus according to claim 5, in which the data 
to be quantised are DCT data. 

7. Apparatus according to claim 6, in which the subset 
of data comprises a predetermined number of low- 
est spatial frequency coefficients of the DCT data. 

8. Apparatus according to claim 6, in which the subset 
of data comprises a predetermined number of non- 
zero lowest spatial frequency coefficients of the 
DCT data. 
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Apparatus according to claim 6, in which the subset 
of data comprises a predetermined number of nu- 
merically largest spatial frequency coefficients of 
the DCT data. 
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(57) Data compression apparatus in which input da- 
ta is compressed according to a target output data quan- 
tity using a stage of data quantisation, the apparatus 
comprises: one or more trial quantisers for selecting a 
degree of quantisation so that the target output data 
quantity is not exceeded; a data selector for selecting a 
subset of the current data to be quantised; a data store 
for storing the subset of data; a backsearch quantiser 
and dequantiser for sequentially quantising and de- 
quantising the subset of data at a plurality of degrees of 
quantisation including the degree of quantisation select- 



ed by the trial quantiser(s) and one or more harsher de- 
grees of quantisation; a comparator for comparing data 
quantised and dequantised by the backsearch quantiser 
with the stored subset of data, to detect errors intro- 
duced by the quantisation and dequantisation by the 
backsearch quantiser; and a quantisation selector for 
selecting a final degree of quantisation for use in com- 
pression of the current data, the final degree of quanti- 
sation being that degree detected by the comparator to 
introduce the fewest errors during quantisation and de- 
quantisation of the subset of data by the backsearch 
quantiser. 
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